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Since much of the knowledge contained in the school's curriculum is trans- 
mitted through the medium of written language, the failure or success of the 
educational enterprise is heavily dependent upon how well students are able to 
comprehend the language in their instructional materials. Unf ortunately , the 
testing procedures in current use are unable to provide the information necessary 
for determining how well students are able to understand the syntactic structures 
by which language signals information. Consequently, we have little knowledge 
upon which to base the design of instruction for teaching these language 
comprehension skills. 

This study represents a preliminary attempt to identify these skills and then 
to determine first if the skills identified represent homogenous classes of 
behaviors, second if the skills might be hierarchically related, and third what 
is the general level of performance on these skills displayed by children in 
grade four where comprehension instruction is normally begun in earnest. 



This study contrasts in three important respects with other attempts to 
measure students' comprehension of language. First, it addresses itself to the 
problem of constructing an instructional theory of comprehension rather than to 
the construction of a theory which describes the processes involved in the 
comprehension of syntactic structures. A psychological account of the compre- 
hension processes is, of course, relevant to the instructional theory of compre- 
hension, but it falls short of being sufficient for the design of instruction. 

Tlie contrast between the two types of theory can be understood by considering 
the diagram in Figure 1 showing the operational unit of instruction. A psycho- 
logical theory of language comprehension attempts only to give an account of the 
behaviors represented in block C. The experiments used to construct this theory 
utilize test tasks as in block B and responses as in block F. But the form of the 
test tasks are selected and systematically varied in a way that permits the 
experimenter to infer £ust the nature of the behavior represented in block C. 



A psychological theory is not sufficient for instructional theory, for it 
does not account for all the important sources of variation in the actual 
operational setting of instruction. An inescapable fact of instruction is the 
necessity of using test-like tasks. This forces the instructional theorist to 
take fully into account variation attributable to the behaviors represented by 
blocks D and E, as well as the behaviors represented by block C. The test-like 
tasks are essential in instruction because they provide (a) a means of practicing 
the student in the behavior, (b) a source of feedback to the student which informs 
him of the correctness of his behavior, and (c) a source of feedback to the 
instructor giving him the information necessary for managing and altering the 
instruction. Without these test-like tasks, there is no way to ascertain what, 
if anything, is being learned or even if the student is doing anything at all 
relevant to the instructor's intentions. Hence, the instructional theorist must 
concern himself also with the effects Introduced by the test-like tasks actually 
used in instruction. 
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Figure 1. The operational unit of instruction 



It should also be understood that an instructional theory is not necessarily 
a by-product of the construction of a psychological theory. The psychological 
theorist is free to select a broad range of test-like tasks regardless of whether 
they necessarily force the subject to emit the desired underlying behavior* For 
example, psychologists studying sentence processing frequently employ tasks which 
require the subjects to memorize and repeat sentences* Nhile these tasks may be 
quite adequate to reveal the phenomenon the psychological theorist is interested 
in, he would certainly not claim that children could be taught to comprehend 
sentences merely by memorizing them* Consequently, the psychological theorist 
leaves unexamined the effects of many of the test— like tasks which the instructional 
theorist must examine if he is to select and sequence the content of language 
instruction. 

This discussion should also make it clear that an instructional theory of 
comprehension is incomplete unless it includes net only an account of the difficulty 
of, say, a syntactic structure but also an account of the difficulty of the 
different test-like tasks used to teach that structure. In actual instructional 
practice, a student can be said to have learned a behavior only if he can exhibit 
a correct response to all of the test-like tasks ordinarily used to test that 
behavior. Consequently, the task of the instructional theorist is to provide the 
information by which instruction on the test-like tasks, also, can be designed. 
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The second major contrast between this and other studies of language compre- 
hension is that it rejects the traditional practices followed in taxonomizing 
cognitive skills. The definitions in those taxonomies depend primarily upon the 
introspections of a test writer rather than employing the standard scientific 
practice of referring to publicly observable operations. For example, test 
writers (31oom, 1556, for example) often refer to items which test comp rehens ion 
of important facts , ability to evaluate , and the like. Those authors do not provide 
definitions of these items by which another investigator or a teacher could 
identify, say, a fact much less operations by which others could discriminate 
important from less important facts. 

The method used, to define the items in this study is sufficiently operational 
that these identical items and items of the same types can be derived by any 
person with some competence in linguistics or even, potentially, by a properly 
programmed computer. Thus, this study, as should all studies in instructional 
theory, can claim that its results are replicable across all items and structures 
of the same types as those studied here, without the need to consider the 
possibility that the introspections which the next investigator brings to the 
item writing task might not match the introspections of the original investigators. 

The third contrast is that this study uses a finer grained analysis of what 
is often termed the literal comprehension skills than has heretofore been used. In 
the most analytic studies to date, the practice has been to provide measures of 
at most a half dozen skills. The present analysis included si ills in the three 
broad categories of sentence, anaphora, and intersentence syntax comprehension and 
then further broke these down into a total of 55 skills. 



Procedure 

Tax onomy o£ Comprehension Skill s: In this analysis a comprehension skill 

is defined a 3 the ability to respond correctly to a wh- question which deletes one 
of the Immediate constituents of a syntactic structure. Consider, for example, 
the sentence The small boy rode the black horse, which contains noun phrase 
structures of the form adjective-plus-noun, sma ll boy and b lack horse . For all 
sentences containing such structures a wh- question can be derived roughly by 
deleting the adjective, replacing it with the appropriate wh- pro word, and then, 
if it is not already there, shifting the pro word to the front of the sentence. 
These operations obtain questions like Which boy rode the black horse? and Which 
horse did the small boy ride? Similar questions can be derived from each of the 
different types of structures appearing in English sentences. The label of the 
skill presumably tested by these questions is derived from the structure the ques- 
tion tests. These particular questions, for example, are said to test the 
comprehension of prenominal adjectives. 

The original taxonomy of structures appearing in English sentences identified 
52 structures. (For a detailed listing and definitions of all structures referred 
to in this study see Bormuth, 1969, and Menzel, 1969.) From this set, the 25 
structures which, upon inspection, seemed least likely to be understood by all 
fourth grade students were selected. (Table 2 gives the label and an example of 
each of these structures.) 
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The taxonomy of anaphora used in the study lists 14 different types. An 
anaphoric expression is a pronoun— like structure which shortens or substitutes 
for an expression which is usually antecedent to it and which has the same 
referent as the antecedent. Pronouns are one type of anaphoric expression, but 
so is the expression This boy in The small boy rode the horse . This boy is ja 
good rider. shtfuAens the antecedent, the small boy. A segment of any size may 
serve as the antecedent of an anaphora, from a single word to a whole chapter, 
but this study included only those simple anaphora having an antecedent fully 
contained in the sentence immediately preceding the one containing the anaphoric 
expression. (Table 3 shows the labels and examples of these anaphora.) 

The taxonomy of intersentence syntactic structures consisted of the 16 
categories shown in Table 4. The relative sequential positions of sentences and 
conjunctive expressions signal information about the relationships of the sentences 
to each other. For example, in the appropriate context the order of the sentences 
The boy fell off the horse. Ke broke his arm, signals that the boy’s fall from 
the horse caused the breaking of his arm. But when the order of these sentences 
is reversed, the causality is also reversed permitting the paraphrase The boy ’s 
breaking of his arm caused his fall from the horse . 

Four question types were used to test comprehension of most of the structures 
studied. Since detailed definitions are given elsewhere for each of these question 
£ypes (Bornuth, 1969), only general descriptions will be given here. A rote^ ques- 
tion is derived by deleting one of the members of the structure to be tested, 
replacing it with the appropriate wh- pro word and then shifting the wh- pro word 
to the front of the sentence. Deriving these questions also often requires the 
syntactic transformations known as do insertions , flip-flops (Thomas, 1965), and 
the like. These details are ignored here for the sake of brevity. Table 1 shows 
examples of rote questions. 

Transform questions are derived by first deriving a mediating sentence and 
then deriving a rote question from the mediating sentence. The mediating sentence 
is actually a paraphrase of the original sentence obtained by performing either a 
cleft or passive transformation on the original sentence. For example, either of 
the sentences It was the boy who rode the steed, or The steed was ridden by the 
boy. could have served as mediators for the sentence 

comprehension in Table 1. 

A semantic substitute question is also derived through the use of a mediator 
sentence. To derive a mediator sentence, one or more synonymous terms are 
substituted for terms in the original sentences. The term substituted may be 
symmetrically related to the term in the original sentence in the sense that the 
two terms may be mutually substituted for each other without altering the referen- 
tial meaning of the context. The pair break and fracture seem to be symmetrically 
related in the context broken arm and fractured am. The substituted term may also 
refer to a more inclusive concept which hierarchically dominates the concept 
referred to by the term in the original sentence. The pair horse and steed 
represent such a pair since all steeds are horses but not all horses are steeds. 
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Table 1 

Illustrations of Question Types 



SENTENCE COMPREHENSION QUESTIONS 



Original Sentence: 
Rote; 

Transform: 

Semantic Substitute: 
Compound : 



The boy rode the steed. 

Who rode the steed? 

By whom was the steed ridden? 
’"ho rode the horse? 

By whom was the horse ridden? 



ANAPHORA COt PREHENSION QUESTIONS 



Original Sentences: 
Rote: 

Transform: 

Semantic Substitute: 
Comp ound : 



The boy fell off the steed. He fractured his arm. 
Who fractured his arm? 

Who was it who fractured his arm? 

Who broke his arm? 

Who was it who broke his arm? 



II :TEr SENTENCE SYNTAX QUESTIONS 



Original Sentences: 
Rote: 

Reversal: 

Semantic Substitute: 
Compound : 



The boy fell off the steed. lie fractured his arm. 
What caused the fracturing of the bey’s arm? 

What did the boy’s fall from the steed cause? 

What caused the breaking of the boy’s arm? 

What was the breaking of the boy’s arm caused by? 



Hierarchically related terms are not symmetrically substitutable. !Jhen a 
hierarchically dominant term is substituted to form the mediator sentence, useful 
questions can be derived. But when hierarchically subordinate terms are substituted 
to form the mediator sentence, the answers to the questions derived are indeter- 
minate. For example, given the sentence The boy fell off ? the horse, and the 
derived question Who fell off the steed? it is impossible to answer the question 
because it is uncertain whether the sentence referred to steeds, nags, or some 
other subset of the concept horse. 
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Compound questions represent questions derived by applying both the semantic 
substitute and the transform operations to sentences. 

Questions testing comprehension of anaphoric and intevsentence syntactic 
structures require the construction of mediator sentences by the use of an 
embedding step for their derivation. The anaphora is questioned by embedding 
the antecedent into the sentence containing the anaphoric expression and then 
deriving a wh- question which deletes the portion of the antecedent not appearing 
in the anaphoric expression. For example, from the pair of sentences The very 
small boy rode the horse. This boy was young , we obtain the mediator sentence 
The very small boy who rode the horse wa3 young, in which we may replace either 
very s mall , who rode the horse or both with a wh- pro word. The mediator sentences 
used to derive intersentence syntax questions are formed by nominalizing the pair 
of sentences involved, inserting the appropriate conjunctive verb between them, 
and then replacing one of the nominal i zee sentences with the appropriate pro word. 
The questions in Table 1, for example, were derived from the mediator sentence The 
boy *3 falling off the horse caused the fracturing of the boy’s arm . Note that 
instead of using transform questions to test the intersentence structures a 
reversal question was formed which deleted the sentence not deleted by the rote 
question. 

Intersencence syntax, transform, and semantic substitute questions permit 
options in deriving the mediator sentences. In this study the nominalization and 
sentence paraphrasing transformation options were randomly selected for each 
transform and intersentence syntax question. The semantic substitutes were 
selected by selecting a symmetrically related term if one existed, ana if it did 
not by selecting the hierarchically related term which both met the vocabulary 
constraints of the design and seemed to immediately dominate the original ten.; in 
its hierarchy. 

This manner of deriving questions produces questions of the completion type 
which have traditionally introduced problems of replicable scoring. A theory of 
scoring was developed (Bormuth, 1969) and then applied to the evaluation of the 
responses observed in this study. Since the theory and its results will be 
described in detail elsewhere (Carr, Pearson, and Boesen, 1969) only its gross 
features will be given here. A response was scored correct if it was the exact 
phrase replaced by the wh- pro word in the sentence or mediator sentence from 
which the question was derived. It was also scored correct if it was a correct 
semantic substitute or a grammatically correct anaphora of the phrase deleted. 

TJhen this scoring theory was applied to the 26,400 responses in this study, all 
but roughly .002 of the responses were classifiable as clearly either correct or 
incorrect. That is, nearly all discrepancies between scorers were res^jved as 
a scorer's error in ‘'computing" the response rather than as insoluble differences 
in judgments. 

ilaterials ; Two different sentences or sentence pairs were written to incor- 
porate each of the structures studied, anrl a four or five sentence paragraph was 
then written to Incorporate each of these. In order to reduce syntactic complexity 
to a minimum, a rule was followed which permitted no sentence to contain more than 
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one embedded structure. To reduce the effects of vocabulary difficulty, all words 
wet© selected from a list of words which had been found to be easy to children 
(Dale and Chall s 1948) and then each paragraph was further revised if it seemed to 
contain an unusual usage of those words. 

Each paragraph was printed with its question appearing immediately below it. 
Below the question three blank lines were provided for the student to write his 
answer on. Since there were four question types for each paragraph, four test forms 
n f re rjade f°r each paragraph, each containing the same paragraph but a different 
^ "** - r.ictorc . A test booklet was compiled by randomly selecting one of the four test 
forms for each of the 110 paragraphs. The order of presenting the structures was 
rotated to counterbalance order effects. Thus, every subject was tested on every 
paragraph but no subject responded to more than one question type for a ©iven 
paragraph. 

l est Administration : The subjects were drawn in roughly equal numbers from 

the fourth grades of three schools: an inner city, integrated school, a suburban 

school and a rural school. All the schools were in the upper midwest area. The 
test booklets were randomly assigned to students and the tests administered in the 
regular classroom setting. Although the tests were administered to some* /.hat more 
students, the groups were randomly reduced so that there remained exactly 60 
students responding to each question. The students were permitted all the time 
they needed to complete the tests. 



Results 



The percentages of students responding correctly to each sentence structure 
are shown in Table 2. The structures are ranked from easiest to most difficult 
using the percentages averaged across all four question types. These percentages 
were analyzed using a two factor, four question type by 25 structures, analysis 
of variance design in which the two examples of a structure provided two replicates 
in each cell. Both, the between structures variance ( F , with 24 and 100 d.f. , * 
7.19) and the between question types variance (F, with 3 and 100 d.f., * 5.63) 
were significant at the .01 level and the interaction (F * .75) was not. Rote 
questions were easiest with a mean of .77 followed by transform questions having 
a mean of .71, semantic substitute questions having a mean of .69, and compound 
questions having a mean of .67. 

Table 3 shows the anaphora structures similarly ranked. The between 
structures variation (F with 13 and 56 d.f. » 3.18) was also significant at the 
.01 level but the between question type variation did not reach significance 
(F with 3 and 56 d.f. «* 1.03). The interaction was, again, less than unity (F * .46). 

The same pattern of results vzas obtained from the analysis of the intersentence 
category of syntactic structures. The variation between structures (F with 15 and 
64 d.f. =* 4.82) was significant at the .01 level but neither the variation between 
question types (F with 3 and 64 d.f. * 1.59) nor the interaction (F * .95) was 
significant. Table 4 shows the difficulties of these structures. 
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Table 2 

Percentage of Students Responding Correctly to Questions 
Testing Each of the Sentence Structures 



Structure 


Percent 

Correct 


Comparative, unequal 

(Joe runs faster than Bill. ) 


88.3 


Nominal Compound, noun + verb + preposition + noun 
(Hammer blow, a blow struck with a hammer) 


87.9 


Lteminalization, possessive + verb + ing 
(His going came as a surprise.) 


87.0 


Prenominal Adjective 

(The tall boy is Joe.) 


05.5 


Subordinate Sentence, causal 

(We cane because we smelled lunch being served.) 


83.3 


Relative Clause, with deletion 

(The nan working in the yard is the owner.) 


80.9 


Nominal! z at ion, verb + ing 
(Finding him was easy.) 


80.0 


Adjectival Prepositional Phrase 

(The man with the hat manufactures cans.) 


80.0 


Subordinate Sentence, After 

(After we entered, the play began.) 


79.3 


Nominalization, factive 

(The fact that he came surprised us.) 


7£.9 


Subordinate Sentence, although 

(Although it rained recently, the ground remains parched.) 


77.3 


Nominal Compounds, verb + ing 

(Washing machine. The machine is for washing clothes.) 


77.3 


Subordinate Sentence, purposive 

(In order to make certain, we asked a second time.) 


70.3 


Relative Clause, appositive 

(llr. Joseph, who is our mailman, retired.) 


73.7 
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Table 2 (continued) 



Structure 




Percent 

Correct 


Nominal Compound, someone operates 

(Elevator ooerator, Someone operates an 


elevator.) 


71#7 


Subordinate Sentence, conditional 

(If we don’t hurry, we’ll miss the show 


.) 


70.5 


Nominal Compound, moun + preposition + noun 
(Hanger station, a station for rangers) 




69.:. 


Nominalization, for- to 

(For us to find him was difficult.) 




65.6 


Nominal Compound, preposition + noun 

(Potato dumpling. The dumpling is made 


from potatoes.) 


67.4 


Relative Clause, without deletion 

(The man who has been working in the yard is the owner.) 


67.0 


Adjective Compliment 

(He is clever to go.) 




66.2 


Subordinate Sentence, before 

(Before we arrived, people had already been seated.) 


65.1 


Subordinate Sentence, tense shift if clause 
(If you had some money, you would buy s 


ome.) 


61. A 


Subordinate Sentence, simultaneous 

(As we entered, the curtain rose.) 




56.1 


Comparative, equal 

(Joe runs as fast as Bill.) 




28.1 



There were also differences among the categories of structures. The mean 
percentage of the students correctly answering the sentence comprehension ques- 
tions was 73 per cent; the anaphora comprehension questiois was 77 per cent; and 
the Intersentence questions was 58 per cent. The Intersentence category of 
questions was significantly more difficult than both the sentence questions (t 
with AO d.f. = 3.83) and anaphoric questions (t^ with 30 d.f. = A. 18). The 
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Table 3 

Percentage of Students Responding Correctly to Questions 
Testing Each of the Anaphoric Structures 



Structures 


Percent 

Correct 


Pro-clause, so 

(Joe may go. If so. we will ....) 


86.3 


Pro- adverb . .. 

(. e works in the cellar. It is cool there.) 


33.2 


Relative Pronouns 

(The man who lives next door nakes . . . . ) 


• o 


Fro -verb, so - do 

(Joe likes tennis. So does Dill.) 


82.3 


Deleted Modifier 

(The small boy cane. This boy is ....) 


82.4 


Noun Phrase Demonstrative 

(The black horse belongs to Joe. That is his ....) 


81.5 


Numeric Pronominal 

(Several men went fishing. Two caught ....) 


81.0 


Inclusive Pronoun 

(Joe, Bill, and liary went to the show. All enjoyed ....) 


30.5 


Deleted Noun 

(There are ripe and green apples. The green (. . .) are nine.) 


78.6 


Pro-verb, so - be/have 

(Joe is sick. So is Rill.) 


76.1 


Negated Pronoun 

(Bill and Joe went shopping. h£ one bought . . . . ) 


67.4 


Clause Demonstrative 

(Joe is stuck in the mud. This leaves us ....) 


66.3 


Semantic Substitute 

(Those steel towers are antenna^. These objects are ....) 


65.5 


Personal Pronouns 

(Joe left the room. He had . . . . ) 


64.5 



11 



* 



Table 4 

Percentage of Students Responding Correctly to Questions 
Testing Each of the Intcrsentence Structures 



Structures Percent 

Correct 

Effect 79.0 

(The gear slipped off. The machine stopped.) 

Cause 71.3 

(The machine stopped. The gear had slipped off.) 

List 6£.9 

(Three came. Joe, Sill, and : iary were the ones.) 

And 67.3 

(Joe is a good hunter. He also skis well.) 

Label 66 . 1 

(Joe skis well. He is Bill’s brother.) 

Hut 65.9 

(Bill said there was too much. Joe said there wasn’t.) 

Explanatory 64.4 

(Joe quit the team. lie did not get to play enough.) 

However 63.5 

(The gear slipped off. Surprisingly, the machine continued to run.) 

Or, exclusive 56. 6 

(Joe may have taken it. But it could have been Bill.) 

Parenthetical 52.9 

(Joe had a cold. Colds seem common, don't they? His mother kept 
him home.) 

Example 50.3 

(Mammals are warm blooded. Hen and dogs are mammals.) 

Although 49 . 9 

(The machine continued to run. This was inspite of the fact that 
the gear . . . . ) 
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Table 4 (continued) 



Structures 



Before 

(They had bean working. Now they just stood there.) 

Rule 

(Men and dogs are mammals. Mammals are warm blooded.) 

While 

(Joe held the paper in his left hand. T ith his right hand he ....) 

After 

(Joe found the others. He had looked everywhere for them.) 



Percent 

Correct 

4b. 3 
46.9 

44.0 

33.0 



difference between sentence and anaphoric questions exhibited a Jt of less than 
unity. However, it should be recalled that, while the intersentence and anaphora 
structures tested exhausted their respective taxonomies, only those sentence 
structures were tested which seemed subjectively to be the more difficult ones jin 
that category. 



Discussion 



By far the most startling result of this study was the fact that large pro- 
portions of the students were unable to demonstrate a comprehension of the most 
basic syntactic structures by which information is signaled in langauge. The 
success or failure of the educational process depends heavily upon the students 
having mastered these language comprehension skills. Yet, if these data are to 
be believed, large portions of the students tested were unable to demonstrate 
anything approaching such a mastery. And efforts to extrapolate these results to 
the general population lead only to a still grimmer picture since the school 
personnel claimed that the groups tested in this study ranged from average to 
well above averse when their scores were compared to the national norms on the 
reading comprehension tests used by the schools. Consequently, these results 
deserve careful criticism. 

The most common fallacy educators fall into in rationalizing test results grow? 
from the fact that a conceptual distinction can be made between a student's having 
acquired a basic capability and his having acquired the instrumental capabilities 
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required to exhibit the basic capability on a test— like task* If this distinction 
can be accepted as meaningful 9 then it becomes a trivial matter to explain away 
results such as those reported here simply by arguing that the students quite 
possibly had acquired the basic competencies but that the data merely reflected 
the varying degrees to which the students had mastered the instrumental competencies 
necessary to demonstrate their basic competencies when faced with a test— like task* 

VThile this distinction between basic and instrumental competencies is quite 
useful for some purposes, its use in this instance is fallacious because it 
refers to a statement which is meaningless in the most fundamental scientific and 
practical sense. A publicly verifiable claim, the only kind of claim having either 
scientific or practical significance, cannot be made that a student has gained a 
basic competency until that increment is observable in his publicly observable or 
overt behavior, and the situation which calls forth that behavior can always be 
conceptually regarded as involving instrumental competencies unique to it. 
Consequently, when a practitioner recognizes this conceptual distinction he is 
forced to forego the use of all practice e::ercises which provide practice for 
the student and feed-back to himself and the student. In actual practice, the 
unit of content must include not only the basic competency but also all of the 
i ns trumental competencies involved in the testing of the basic competency. Restated 
in the vernacular of the classroom, teachers must not only teach for a test, th<^y 
must teach for every type of test likely to be used to elicit a demonstration of 

that competency. 

So the interpretation of the present results is not affected by the argument 
that instrumental skills were involved, since no operational distinction of this 
sort is meaningful. However, it is reasonable to ask If the instrumental skills 
called for by the test-like tasks used in this study were so unreasonably difficult 
that they masked the basic competencies of the students. This seems unlikely to 
have occurred. The wh- questions used in this study are among the most common 
devices for testing competency. And careful attention was paid to holding the 
vocabulary and syntactic complexity of the materials to a minimum. Furthermore, 
no time limits were imposed either explicitly or implicitly on the testing 
situation and the tests were even arranged to conveniently facilitate the child 
referring back to the paragraph as he attempted to ansver each question. 

Thus, these data may actually over estimate the performance of students in 
actual instructional situations rather than underestimating it. For example, in 
a recent study (Uormuth, 1968) evidence was presented which indicated that only 
the most able elementary school children can gain information from the verbal 
instructional materials they are required to study and that even these students 
seem able to gain Information only from the easiest of their materials. 

Turning to the second problem investigated, it seems that the comprehension 
skills defined in this analysis represent fairly homogenous classes of behavior. 
This was shown by the fact that there were significant differences both between 
the difficulties of the major categories of structures and between the structures 
within the major categories. It is, of course, impossible from these data to 
certify that any two of the comprehension skills studied are indeed different 
behaviors. Such an analysis will require the use of many more test items of each 
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kind with careful attention being given to the effects the placement of a structure 
has on its difficulty. In this study these effects were randomized in so far as 
these placement options could be identified. 

The difficulty ranking of skills is of fundamental importance in the design 
of Instruction, since those rankings often reflect hierarchical relationships 
among the skills and thereby reveal the order in which skills should be taught. 

The fact that there were significant differences both among question types and 
among the structures within each major category suggests that such hierarchies 
exist. Interestingly enough, one of these appeared to run counter to the pre- 
dictions which would have been made from transformational grammar. The transfor- 
mational theory of grammar asserts that prenominal adjectives are derived from 
relative clauses with deletions which, in turn are derived from relative clauses 
without deletions. This would make prenominal adjectives the most complex and, 
therefore, the most difficult structure to comprehend. As it turned out, this 
order was exactly reversed. However, this result should be regarded as very 
tentative since this study was not designed to discriminate sharphy between 
individual pairs of structures. 

There were also indications that the major categories of structures may be 
hierarchically related as saown by the fact that they differed in difficulty. This 
ordering of difficulty was roughly the same as one would derive from linguistic 
theory. The expected ordering was that sentence structures would be easiest to 
comprehend, anaphora would be second, and intersentence structures the most 
difficult. The apparent reversal of this order occurring between sentence and 
anaphoric structures is likely to have been due to the fact that most of what 
subjectively seemed to be the easiest sentence structures were excluded from the 
study in the apparently mistaken belief that virtually all of the students would 
have demonstrated perfect performance on the items testing them. 

There were also differences among the question types. While those differences 
were large enough to be considered significant only in the case of the sentence 
structures, all of the differences were in the expected directions. That is, rote 
questions were the easiest and compound questions the most difficult, while 
transform and semantic substitute questions ranged somewhere between the rote and 
compound questions. This outcome was expected because the procedures for deriving 
the questions themselves involve a hierarchy of operations. 



Summary and Conclusions 



This study represents a preliminary attempt to identify and operationalize 
the skills employed in comprehending the information signaled by the syntactic 
structures of language and then to determine if the skills identified represent 
homogenous classes of behavior, whether these skills might be hierarchically 
related, and finally what is the general level of performance on these skills 
displayed by fourth grade children. 
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From a taxonomy of 52 types of sentence structure, the 25 judged to be the 
most difficult were selected for testing. Also all 16 of the intersentence and all 
14 of the anaphoric structures identified were tested. To do so two sentences 
containing a structure were written and each embedded in its own paragraph. Then 
four types of questions were constructed to test the structure being tested. Each 
structure with its questions was then used to test 60 fourth grade children. 

The most startling result was the fact that large proportions of the children 
were unable to demonstrate a comprehension of even these basic structures by which 
information is signaled indicating that this deficiency may constitute a serious 
impediment to the efficiency of instruction. The structures identified seemed to 
represent homogenous classes of behavior since the variation between questions 
measuring different skills was significantly greater than the variation between 
items measuring the same skill. The fact that the structures and question types 
differed significantly in difficulty was also taken as evidence that many of these 
skills may be hierarchically related. 
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